Skip to content

Feature/async sync adapter v2#15

Closed
karaposu wants to merge 4 commits intobrightdata:refactor-asyncfrom
karaposu:feature/async-sync-adapter-v2
Closed

Feature/async sync adapter v2#15
karaposu wants to merge 4 commits intobrightdata:refactor-asyncfrom
karaposu:feature/async-sync-adapter-v2

Conversation

@karaposu
Copy link
Copy Markdown
Contributor

No description provided.

karaposu and others added 4 commits December 16, 2025 14:53
- Remove GenericScraper class (use client.scrape_url() directly)
- Fix async naming: method() is async, method_sync() is sync
  - products_async() → products()
  - wait_async() → wait()
  - fetch_async() → fetch()
- Add _ensure_initialized() checks for context manager usage
- Update CLI scrape command from 'generic' to 'url'
- Update all tests and examples to use new method names
- Simplify README documentation
- Add comprehensive sync_client.py with full scraper coverage

BREAKING CHANGE: GenericScraper removed, use client.scrape_url() instead

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
- Document GenericScraper removal
- Document async naming convention change (_async → no suffix)
- Document new SyncBrightDataClient with full coverage
- Update v2.0.0 examples to use new method names
- Reduce README from 419 to ~160 lines
- Remove platform-specific examples (LinkedIn, Instagram, Facebook)
- Rename 'Amazon Scraping' to 'Web Scraper API' with general explanation
- Add docs/sync_client.md with full sync client details
- Add non-blocking async mode using /unblocker/req and /unblocker/get_result endpoints
- SERP async: ~3 seconds, Web Unlocker async: ~2 minutes (sync recommended for single URLs)
- Fix SyncBrightDataClient: remove unused customer_id parameter
- Fix Web Unlocker poll_timeout default: 30s → 180s
- Simplify API: remove _async suffix, method() is now async by default
- Add AsyncUnblockerClient for trigger/poll/fetch workflow
- Add comprehensive async mode guide and update documentation
- Delete unused demo files, update all unit tests

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@karaposu karaposu closed this Jan 5, 2026
@karaposu karaposu deleted the feature/async-sync-adapter-v2 branch January 5, 2026 08:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant